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For SYSTEM FOR FORMATTING AND PROCESSING 

MULTIMEDIA PROGRAM DATA AND PROGRAM 
GUIDE INFORMATION 



PRELIMINARY AMENDMENT 



Hon. Assistant Commissioner for Patents 
Box PCT 

Washington, D.C, 20231 
Sir: 



In the US national phase application of PCT/US98/21 556 
filed herewith, please enter the following amendments: 



IN THE CLAIMS: 

Please amend the claims (which are annexed to the 
International Preliminary Examination Report) as indicated below: 

1. (AMENDED) Apparatus for decoding packetized program 
information from a first source to provide data content of a program, 
comprising: 

means for identifying [(22,60)] ancillary information in said 
packetized program information, said ancillary information including 
information describing a multimedia object associated with an image in 
said packetized program information, said multimedia object description 
information comprising, 

(a) a location indicator [(610)] identifying a location of 
a multimedia object for use in acquiring said multimedia object, and 

(b) a type indicator [(605)] identifying a multimedia 
object type for use in decoding said multimedia object; and 

means for acquiring and decoding [(22, 30, 60)] said 
multimedia object using said multimedia object description information; 
and 

means for formatting [(30, 37, 60)] said multimedia object 

for display. 
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3. (AMENDED) Apparatus according to claim 2, wherein 
said location indicator identifies a location of said multimedia 
object derived from said first source using one of (a) an MPEG compatible 
packet Identifier [(PID)], (b) an MPEG compatible Digital Storage Media 
code, 

10. (AMENDED) A storage medium containing digital data 
representing video information comprising: 

packetized program information representing a video 
program; and 

ancillary information [{205, 210, 215, 220)] including 
information describing a multimedia object associated with an image in 
said packetized program information, said multimedia object description 
information comprising, 

(a) a location indicator [(610)] identifying a location of 
said multimedia object for use in acquiring said multimedia object, and 

(b) a type indicator [(605)] identifying a multimedia 
object type for use in decoding said multimedia object; and 

information [{215; 825; 840)] for associating said 
multimedia object with an image in said packetized program information. 

14. (AMENDED) A method according to claim 13, wherein 
said location indicator identifies a location of said multimedia 
object from said first source using one of (a) an MPEG compatible packet 
Identifier [(PID)], (b) an MPEG compatible Digital Storage Media code. 

IN THE ABSTRACT 

Please add the Abstract as indicated on the attached page. 
REMARKS 

The above amendments to claims 1,3, 10 and 14 have been 
made to eliminate reference indicia. Claims 1-2, 4-9, 11-13 and 15-48 
(as annexed to the International Preliminary Examination Report) are 
unchanged. No new matter is added. 
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To meet the requirements of the United States, the Abstract 



(as originally filed in the PCT application) is added. Reference indicia has 
also been deleted. 



No fee is believed to have been incurred by virtue of this 



amendment. However if a fee is incurred on the basis of this amendment, 
please charge such fee against deposit account 07-0832 



THOMSON multimedia Licensing Inc. 
Patent Operation 
PO Box 5312 

Princeton, NJ 08543-5312 

APR 0 6 ?m 



Respectfully submitted, 
Mark Jacob Ebling 
Edwin Arturo Heredia 
Sithampara Niranjan 
Chia-Yuan Teng 
Mehmet Kemal Ozkan 
Timothy William Saeger 




Alexander J. Burke 
Registration No. 40,425 
609/734-9503 



3 



RCA 88759 



Abstract 

A program specific information data structure facilitates 
communication of program content and program guide data with attached 
5 multimedia objects including audio, video, animation, still image, Internet, Email, 
text and other types of data. The data structure supports uni-directional 
communication applications, e.g. passive viewing, and bi-directional 
communication applications, e.g. interactive type functions. A decoder processes 
packetized program data and program specific information containing ancillary 

10 description information including multimedia object type, location and other 
descriptive indicators. These indicators are used in acquiring and decoding 
multimedia objects derived from different sources for presentation in composite 
video images representing video program content or program guides, for 
example. Additional ancillary location and acquisition description information 

15 enables acquisition of supplementary program specific information elements and 
program content data. 
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System for Formatting and Processing Multimedia Program Data and 

Program Guide Information 

Field of the Invention 

5 

This invention is related to the field of digital signal 
processing, and more particularly to the acquisition, formation and 
processing of Multimedia program guide and program content 
Information. 

10 

Background of the Invention 

Home entertainment systems which combine Personal 
Computer and television functions (PC/TV systems), are increasingly 

15 becoming, generic. User interactive, multiple source and multiple 
destination communication devices. Such multimedia systems are 
required to communicate in different data formats between multiple 
locations for a variety of applications in response to User requests. For 
example, a PC/TV system may receive data from satellite or 

20 terrestrial sources comprising High Definition Television (HDTV) 
broadcasts. Multi-point Microwave Distribution System (MMDS) 
broadcasts and Digital Video Broadcasts (DVB). A PC/TV system may 
also receive and transmit data via telephone (e.g. the Internet) and 
coaxial lines (e.g. cable TV) and from both remote and local sources 

25 such as Digital Video Disk (DVD), CDROM, VHS and Digital VHS 
(DVHS™) type players, PCs, and many other types of sources. 

Forming and processing program guide data containing 
program content from numerous sources for multimedia applications 
presents a number of problems for such a generic PC/TV 

30 entertainment system. For example, such a system may be required 
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to process multimedia content including audio clips, video clips, 
animation, still images, text and other types of data encoded in 
different data formats. Specifically, difficulties arise in structuring 
program content and program guide data to facilitate the acquisition 
5 and decoding of multimedia content of different data format and from 
different sources. These problems and derivative problems are 
addressed by a system according to the present invention. 

Summary of the Invention 

10 

A program specific information data structure facilitates 
communication of program content and program guide information 
with attached multimedia data including audio, video, animation, still 
image, Internet, Email, text and other types of data. The data 

15 structure supports uni-directional communication applications e.g. 
passive viewing and bi-directional communication applications e.g. 
interactive type functions. A decoder processes packetized program 
data containing ancillary description information including 
multimedia object type, location and other descriptive indicators. 

20 These indicators are used in acquiring, and decoding multimedia 
objects derived from different sources for presentation in composite 
video images representing video program content or program guides, 
for example. Additional ancillary location and acquisition description 
information enables acquisition of supplementary program specific 

25 information elements and program content data. 
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In the drawing: 

Figure 1 shows an exemplary hierarchical program guide 
5 data structure for conveying multimedia object data, according to the 
invention. 

Figure__2^ shows an exemplary program guide display 
containing multimedia objects, according to the invention. 

Fj^ures^^^^^ show, respectively, a Master Guide Table 
10 (MGT), Additional Guide Data Table (AGDT), Channel Information 
Table (CIT) and a Multimedia Object Descriptor (MOD) Table used in 
the hierarchical data structure of Figure 1, according to the invention. 

Figure 7 describes the elements of the Multimedia Object 
Descriptor (MOD) Table of Figure 6, according to the invention. 
15 Figures 8 and 9 respectively list and describe other 

descriptors that may be incorporated in program specific information 
to facilitate multimedia data acquisition and decoding, according to 
the invention. 

Figures 10, 11 and 12 list acquisition descriptors for use in 
20 acquiring multimedia objects from exemplary locations including 
Internet locations, digital storage media datastream locations and 
MPEG PSI stream locations respectively, according to the invention. 

Figure 13 shows an acquisition descriptor for acquiring 
program specific information and multimedia objects from different 
25 sources including MPEG PSI streams and Internet locations, for 
example, according to the invention. 

Figure 14 shows an exemplary list of the types of tables 
that may use the acquisition descriptor of Figure 13, according to the 
invention. 
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Figures 15 and 16 respectively show location descriptors 
for use in identifying multimedia content data from different sources 
including an MPEG compatible source and a Digital Satellite System 
5 (DSS) source, according to the invention. 

Figure 17 shows a flowchart of a method for forming 
program specific information to convey multimedia objects, according 
to the invention. 

Figure 18 shows a home entertainment decoder system 
10 for forming and decoding multimedia program data and program 
guide information, according to the invention. 

Detailed Description of the Drawings 

15 Program specific information (PSI) includes program guide 

data and information for use in identifying and assembling individual 
data packets to recover the content of selected program channels. 
Program specific information and associated program content is 
advantageously structured to support communication of multimedia 

20 objects including audio clips, video clips, animation, still images, 
Internet data. Email messages, text and other types of data. 
Multimedia objects are data entities that may be viewed as 
independent units and are associated with images within individual 
programs or with program guide components. The multimedia objects 

25 are incorporated into composite video images representing a program 
guide or a video program, for example. The data structure supports 
uni-directional communication applications e.g. passive viewing and 
bi-directional communication applications e.g. interactive type 
functions and also supports storage applications. 
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The program specific information and associated program 
content may be delivered by different service providers via the 
Internet, or via terrestrial, satellite or cable broadcast on a 
subscription or other pay per view basis. The data structure facilitates 
5 acquisition and decoding of multimedia objects encoded in different 
data formats and which are communicated in different 
communication protocols from both local and remote sources. An 
exemplary decoder, receives program content from satellite, cable and 
terrestrial sources including via telephone line from Internet sources, 

10 for example. 

Hereinafter, data referred to as being MPEG compatible 
conforms to the MPEG2 (Moving Pictures Expert Group) image 
encoding standard, termed the "MPEG standard". This standard is 
comprised of a system encoding section (ISO/IEC 13818-1, 10th June 

15 1994) and a video encoding section (ISO/IEC 13818-2, 20th January 
1995). 

Data structure elements according to the invention 
principles may be conveyed in MPEG compatible format (per section 
2.4.4 of the MPEG systems standard) or may be conveyed in a format 

20 compatible with the Program and System Information Protocol for 
Terrestrial Broadcast and Cable, published by the Advanced 
Television Systems Committee (ATSC), 10 November 1997, 
hereinafter referred to as the PSIP standard or other ATSC standards. 
Further, the data structure elements may be formed in accordance 

25 with proprietary or custom requirements of a particular system. 

The principles of the invention may be applied to 
terrestrial, cable, satellite, Internet or computer network broadcast 
systems in which the coding type or modulation format may be 
varied. Such systems may include, for example, non-MPEG compatible 

30 systems, involving other types of encoded datastreams and other 
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methods of conveying program specific information. Further, although 
the disclosed system is described as processing broadcast programs, 
this is exemplary only. The term 'program' is used to represent any 
form of packetized data such as audio data, telephone messages, 
5 computer programs, Internet data or other communications, for 
example. 

Figure 1 shows an overview of an exemplary hierarchical 
program specific information data structure for conveying multimedia 
object data, according to the invention. The structure comprises 

10 multiple hierarchically arranged and inter-linked tables and 
multimedia objects (Object 1 and Object 2). The tables consist of 
arrays of data and parameters which are used to enumerate and 
describe collections or sequences of TV channels, TV programs, 
channel parameters, program parameters, associated multimedia 

15 objects and object parameters, etc. The exemplary hierarchical table 
arrangement of Figure 1 includes a Master Guide Table (MGT) 205, 
Additional Guide Data Table (AGDT) 210, Channel Information Tables 
(CIT-l, CIT-2, CIT-3), Event Information Tables (EIT-1, EIT-2), 
Network Information Table NIT 220, and optional tables such as 

20 Extended Channel Information Tables (ECIT-1, ECIT-2, ECIT-3), and 
Extended Event Information Tables (EEIT-1, EEIT-2). 

The MGT contains information for use in acquiring 
program specific information conveyed in other tables and 
specifically, in this exemplary embodiment, provides information for 

25 use in acquiring the AGDT. The AGDT contains information for 
determining the structure and table partitioning of the program 
specific information. The CIT contains information for tuning and 
navigation to receive a User selected program channel. The EIT 
contains descriptive lists of programs (events) receivable on the 

30 channels listed in the CIT. Either a CIT, EIT or other table may be used 
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to convey information enabling a user to select and tune to a 
particular program, A CIT is typically used to convey parameters for 
acquiring audiovisual program content data that remains constant 
over several events (TV programs). An EIT is typically used to convey 
5 parameters of audiovisual program content data that remain constant 
for an event (individual TV program). The NIT contains parameter 
lists for the entire broadcast network (terrestrial, satellite, cable, etc.). 
The ECIT and EEIT are extension tables accommodating additional CIT 
and EIT information. Additional program specific information 

10 describing and supplementing items within the hierarchical tables is 
conveyed within descriptor information elements. 

This data structure advantageously enables multimedia 
objects and table information located at a plurality of different 
remote and local sources to be acquired at a decoder and assembled 

15 to produce an individual program and program guide for display to a 
user. The data structure incorporates address and protocol 
information for identifying and acquiring tables and objects from a 
variety of sources. The data structure enables objects to be positioned 
anywhere in a program guide and to be associated with individual 

20 program specific information table elements. A decoder uses the 
address and protocol information and other parameters in the data 
structure to acquire and format a composite program guide and 
programs from tables and objects derived from a plurality of 
distributed sources. As such the data structure offers flexibility and 

25 adaptability advantages and provides a comprehensive mechanism 
for conveying a multiplicity of distributed multimedia objects in a 
manner that facilitates efficient decoding and reproduction of 
composite video images and audio segments. Other methods of 
partitioning program specific information may be used in conveying 

30 multimedia objects and may achieve similar flexibility, adaptability 
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and efficiency advantages by employing the table structuring, and 
multimedia object definition and acquisition information, according to 
the invention principles. The elements of the data structure presented 
in Figures 1-16 are considered to be optional and may be used or 
5 omitted based on the requirements of a particular system. 

Figure 2 shows an exemplary program guide display that 
may be produced by a decoder from the program specific information 
structure, according to the invention. The program guide contains 
multimedia objects and provides a user interface that supports Email, 

10 telephone, fax, Internet browsing, storage, home shopping, home 
banking (420-433) and other functions. Multimedia objects such as 
video clips, Internet web page data or still images may be displayed 
in area 435 in response to user selection of a preview icon (e.g. 447, 
449) or a web page icon (e.g. 443). Data and text such as Email 

15 messages, sports results or stock quotes etc. are displayed in area 43 9 
in response to user selection of a results icon (e.g. 445) or in response 
to user selection of functions 420-433. Advertisements and animation 
may similarly be displayed in area 437. 

Figures 3-6 show, respectively, a Master Guide Table 

20 (MGT), Additional Guide Data Table (AGDT), Channel Information 
Table (CIT) and a Multimedia Object Descriptor (MOD) Table used in 
the hierarchical data structure of Figure 1, according to the invention. 
Figure 3 shows an MGT providing pointer information specifically for 
use in acquiring the AGDT. 

25 Figures 4 and 5 comprise an exemplary AGDT for 

conveying information for acquiring and assembling the other tables 
and components of the program specific information. The AGDT 
describes the structure and locations of the data partitions that are 
used in conveying the program specific information. A decoder uses 

30 the control information in the AGDT in assembling the program 
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specific information and in creating a program guide for display. 
Although the AGDT is shown as separate Figures for clarity (Figures 4 
and 5), the AGDT actually comprises a single table in which the syntax 
of Figure 5 occupies the program_guide_map element 415 of Figure 4. 
5 The AGDT syntax of Figure 4 indicates a first level of 

program specific information partitioning and provides: 

• An overall description for the entire guide (e.g. descriptor 
405). 

10 •A definition of partitioning of network parameters (for 

cable, terrestrial, digital broadcast satellite, Internet, type 
networks, for example). 

One or more pointer descriptors may be inserted at line 
15 405 of Figure 4 to indicate the location of the entire program specific 
information and/or its table components. Similarly, if network-based 
partitioning is used, the location of network information tables can b e 
indicated by inserting proper pointer descriptors in Une 410. Table 
pointer descriptors comprise acquisition descriptors as exemplified by 
20 the syntax structure of Figure 13 which is discussed later. Further, 
multimedia object descriptors (MODs) may be inserted in the AGDT at 
line 405, to associate multimedia objects external to the program 
specific information with the program specific information (or 
program guide) as a whole, or may be inserted at line 410, to 
25 associate external objects with particular network parameter 
arrangements. An external multimedia object is an object that is 
provided by a remote or local source and is not conveyed within the 
program specific information itself. For example, an advertisement 
sponsoring a program guide conveyed within the program specific 
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information may be linked to the guide for display by using one or 
more MODs in line 405. 

In order to support such a function, an MOD 
advantageously incorporates indications of: 

5 

• the type of object being described (e.g. Email MIME format, 
Internet HTML, still image JPEG format, video clip MPEG2 
format etc.) 

• the location of the object (PSI bit stream, FTP site, WWW site, 
10 DSM-CC stream, etc.) 



An exemplary MOD syntax structure incorporating an 
object type indicators and address location pointer is presented in 
Figure 6 and is discussed in more detail later. 

15 The AGDT syntax of Figure 5 indicates a second level of 

program specific information partitioning that may be used to 
partition program specific information by time segment and channel 
characteristic or group. The program specific information time 
segment partitions are defined by a syntax element loop beginning at 

20 line 510. Pointer (location) descriptors for locating tables or objects 
may be inserted at line 515. Further, one or more additional pointer 
descriptors may be inserted at line 505 of Figure 5 to indicate the 
location of multimedia objects and tables that are valid for all the 
time segment partitions. The program specific information channel 

25 characteristic partitions are defined by a syntax element loop 
beginning at line 520 and pointer (location) descriptors for locating 
tables or objects for particular channel groups may be inserted at line 
525. Further, multimedia object descriptors (MODs) may also be 
inserted in the AGDT descriptor sections of Figure 5 to associate 
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multimedia objects external to the program specific information with 
particular time segments or channel groups. As previously stated, 
AGDT elements may be viewed as optional in tailoring the data 
structure for particular system requirements. For example, the 
5 previously described syntax enabling partitioning of the program 
specific information into different channel groups may be omitted in a 
particular application. 

Figure 6 shows an exemplary multimedia object descriptor 
(MOD) for use in defining multimedia objects to be incorporated in 

10 displayed program content or in a displayed program guide, for 
example. The MOD syntax shown in Figure 6 may be incorporated in a 
plurality of locations throughout the program specific information 
structure in order to associate multimedia objects with individual 
image or data components of a program guide or program content. 

15 The MOD identifies objects associated with program specific 
information components using the object type field (line 605) and 
identifies the location of the object to enable its acquisition using the 
address descriptor field (line 610). The key elements of the MOD 
shown in Figure 6 may be advantageously used for conveying 

20 multimedia object acquisition information in a wide variety of data 
transport structures that may be used to deliver program content or 
program guide information. Such transport structures, for example, 
may include MPEG-PSI, Internet TCP/IP (Transport Control 
Protocol/Internet Protocol), DSS (Digital Satellite System), ATM 

25 (Asynchronous Transfer Mode) etc. 

Figure 7 describes the elements of the Multimedia Object 
Descriptor (MOD) of Figure 6. 

Figure 8 (items 805-850) and Figure 9 respectively list 
and describe other descriptor types that may be incorporated in 
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program guide information to facilitate multimedia object acquisition 
and decoding, according to the invention. 

Figures 10, 11 and 12 list address descriptors for use in 
acquiring multimedia objects from exemplary locations including 
5 Internet locations, digital storage media datastream locations and 
MPEG PS I stream locations respectively. Any or all of these address 
descriptors (or alternatively defined address descriptors) may be 
included within the MOD at line 610 of Figure 6, The descriptor of 
Figure 10 identifies web-based locations from which multimedia 

10 objects are acquired using an Internet URL address 905. The 
descriptor of Figure 11 identifies objects in a DSM-CC (Digital Storage 
Medium-Command and Control) stream from which multimedia 
objects are acquired using a DSM-CC_association„tag 910 as a link 
with a particular object in a DSM-CC carousel. The descriptor of Figure 

15 12 identifies locations of objects in an MPEG-2 PSI stream. Within the 
descriptor of Figure 12, item 915 identifies! a particular network (e.g. 
satellite, cable, or terrestrial), item 920 identifies a particular network 
transport stream (transport stream id), item 925 identifies packets 
within a particular stream using a Packet Identifier (PID) and item 

20 930 identifies particular table associations of the packets with table 
identifiers (table_id and table_id„extension). Similar descriptors may 
be derived for other media according to the invention principles 
exemplified in Figures 10-12. 

Figure 13 shows an acquisition descriptor for defining 

25 table locations for acquiring program specific information and 
multimedia objects from different sources including MPEG PSI 
streams and Internet locations, for example. This descriptor may be 
used throughout the program specific information structure to 
identify table locations. The acquisition descriptor of Figure 13 may 

30 be used at line 405 of the AGDT of Figure 4 to identify tables that are 
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not associated with particular program specific information 
parameters. Alternatively, the acquisition descriptor of Figure 13, 
may be used at line 410 of the AGDT of Figure 4 to identify tables 
associated with particular networks. Further, the acquisition 
5 descriptor of Figure 13, may be used in other portions of the AGDT, 
such as within time-based partitions of particular channel groups. As 
an example, the descriptor of Figure 13 incorporates elements for 
acquiring program specific information tables from two separate 
sources. Specifically, 

10 

(1) items 960 and 965 enable data acquisition from MPEG-2 PS I 
streams, and 

(2) item 970 enables data acquisition from an Internet address 
such as from an FTP or HTTP compatible source. 

15 

The Figure 13 descriptor structure is flexible and readily 
accommodates additional different addressing methods through the 
addition of extra "else if statements to the descriptor. In adapting or 
expanding the Figure 13 data structure to encompass additional 
20 addressing elements, item 955 is used to identify the particular table 
being defined in the Figure 13 execution loop and item 95 0 
determines the number of tables for which acquisition locations are 
defined. 

Figure 14 shows an exemplary list of the types of tables 
25 that may use the acquisition descriptor of Figure 13 and that may be 
incorporated into the program specific information structure, 
according to invention principles. In using the acquisition descriptor 
of Figure 13 to acquire the tables listed in Figure 14, the element 
identifier values of the desired table listed within Figure 14 are 
30 inserted in the element identifier field at line 955 of the acquisition 
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descriptor of Figure 13. Other tables may also be acquired, partitioned 
and incorporated in the program specific information structure as 
desired using data structuring principles described. 

Figures 15 and 16 show examples of a location descriptor for 
5 use in acquiring multimedia audiovisual content data from different 
sources using different communication protocols and data formats (as 
distinct from the descriptor of Figure 14 used in acquiring program 
specific information from different sources). The location descriptor 
exemplified in Figures 15 and 16 may be incorporated into program 

10 specific information tables such as into a Channel Information Table 
(CIT) or into an Event Information Table (HIT) and is used to identify 
audiovisual content data within input datastreams. Specifically, Figure 
15 shows an example of a location descriptor for use in acquiring 
audiovisual data from an MPEG compatible source and Figure 1 6 

15 shows an example of the location descriptor data structure for use in 
acquiring audiovisual data from a Digital Satellite System (DSS) 
source. A plurality of location descriptors may be included in program 
specific information in order to acquire audiovisual content data from, 

(a) multiple different sources and types of media (e.g. MPEG, 
20 Internet, cable sources), and 

(b) from different addresses associated with a particular source 
or media type (e.g. from different Internet addresses or cable TV 
channels). 

In the location descriptor example of Figure 15 MPEG 
25 compatible audiovisual data is identified by PID value. The location 
descriptor of Figure 15 includes two methods of data acquisition 
based on PID value. The two methods are referred to as an implicit 
method and an explicit method respectively. Selection between the 
two methods is determined by an input implicit flag indicator 985. 
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In the explicit method, the PIDs, e.g. PID 990, are 
individually listed within a loop beginning at line 987, In the implicit 
method a base PID 993 is defined and other PIDs are derived from 
the base PID in accordance with a predetermined PID definition e.g. as 
5 a function of program channel number and stream type. Such an 
implicit method is known and described for example in an ATSC 
standard. The stream type associated with a particular PID is defined 
by element SType[i] in Figures 15 and 16. 

In the location descriptor example of Figure 1 6 

10 audiovisual data from a Digital Satellite System (DSS) source is 
identified by SCID (Service Component Identifier) value. The location 
descriptor of Figure 16 includes two methods of data acquisition (an 
implicit and explicit method) based on SCID value, in similar fashion 
to the MPEG example of Figure 15. Selection between the two methods 

15 is determined by an input implicit flag indicator 353. 

In the explicit method, the SCIDs, e.g. SCID 355 or 357, are 
individually listed within a "for" loop beginning following line 353. In 
the imphcit method a base SCID 360 or 363 is defined and other SCIDs 
are derived from the base SCID in accordance with a predetermined 

20 SCID definition, as previously mentioned. In the DSS case, however, 
the SCID values may have two different sizes. Consequently, within 
the DSS location descriptor structure an input selection parameter 
(Z_bit) is used in selecting between SCID values. Specifically, in Figure 
16 selection parameter (Z„bit) is used in selecting between SCIDs 3 55 

25 and 357 in the explicit case and in selecting between SCIDs 360 and 
363 in the implicit case. 

The descriptor tag 980 of Figure 15 and the descriptor tag 
350 of Figure 16 are used within a decoder for identifying a 
descriptor type and for automatically differentiating between 

30 descriptors. In a decoder, it is determined whether a particular 
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desired channel (and associated progranni) is transmitted from a 
particular source (e.g. satellite, terrestrial, cable, or Internet source) 
and thereupon the corresponding satellite, terrestrial, cable, or 
Internet location descriptor is selected for use. A variety of other 
5 location descriptors may be defined in similar fashion to those 
exemplified in Figures 15 and 16. Such other descriptors may be used 
to acquire digital audiovisual services from sources including, for 
example, streamed audio and video over the Internet, ATM networks, 
etc. 

10 Figure 17 shows a flowchart of a method for forming 

program specific information to convey multimedia objects, according 
to the invention. The method of Figure 17 generates program specific 
information including MGT, AGDT, CIT, ECIT, HIT, EEIT, NIT and ETT 
data and descriptors containing the advantageous features previously 

15 described. The method may be employed at an encoder for 
broadcasting video data or the method may be employed within a 
decoder unit. 

Following the start at step 250 of Figure 17, in step 253, a 
method based on the previously described data structuring principles 

20 is selected for partitioning program specific information. The program 
specific information is partitioned in accordance with network types, 
time segments, channel groups, transport stream channel groupings 
and the programs (events) being transmitted on particular channels. 
In step 255, the locations of table partitions and the tables and sub- 

25 tables (extended tables) required to accommodate the partitioned 
program specific information are identified and descriptors for 
identifying and acquiring the tables and associated multimedia 
objects are formed. In step 257 an AGDT (or another type of control 
table) is generated to include those formed acquisition and 

30 multimedia object descriptors generated in step 257 that apply to the 
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AGDT level of program specific information structure. In addition, an 
MGT is generated in step 257 containing information for use in 
acquiring program specific information conveyed in other tables and 
specifically for use in acquiring an AGDT. 
5 In step 260 individual CIT, ECIT, EIT, EEIT, NIT and ETT 

etc. tables are formed complying with the partitioned structure. The 
individual tables incorporate acquisition descriptors, multimedia 
object descriptors (MODs) and location descriptors derived according 
to the previously described invention principles. A CIT is formed 

10 containing sub-channel and program identification information 
enabling acquisition of available broadcast programs and channels, 
containing packet identifiers for identifying individual packetized 
datastreams that constitute individual programs to be transmitted on 
particular channels. The generated CIT also incorporates items linked 

15 to listed program channels including a program number, a FCR 
(Program Clock Reference) identifier, a language code indicator, and a 
stream type identifier, for example. 

Further, in step 260, an EIT is generated containing 
program guide information including descriptive lists of programs 

20 (events) receivable on the channels listed in the CIT. Also in step 260, 
an NIT is created and an ETT is generated containing text messages 
describing programs, for example. Further, extension tables are 
formed as necessary to accommodate additional partitioned program 
specific information. 

25 In step 263, the tables formed in step 260, together with 

associated multimedia objects, are formatted to be compatible with a 
desired data format and protocol. Such data formats and protocols 
include, for example, MPEG2 compatible Program Specific 
Information, MPEG2 DSM-CC, DSS, and an Internet compatible file 

30 transfer format. In step 265, the resulting formatted tables and 
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multimedia objects are incorporated into a datastream in their 
designated locations for terrestrial transmission. The AGDT is 
incorporated into the datastream in step 267. 

In step 270, the program specific information produced in 
5 step 267, together with video and audio program representative 
components (and other data) for multiple channels, is multiplexed and 
formatted into a transport stream for output. In step 270, the output 
transport stream is further processed to be suitable for terrestrial 
transmission to another device such as a receiver, video server, or 

10 storage device for recording on a storage medium, for example. The 
processes performed in step 270 include known encoding functions 
such as data compression Reed-Solomon encoding, interleaving, 
scrambling, trellis encoding, and carrier modulation. The process is 
complete and terminates at step 275. In the process of Figure 17, 

15 multiple CIT, EIT, ETT and associated extension tables may be formed 
and incorporated in the program specific information in order to 
accommodate expanded numbers of channels. Further, in other 
embodiments the tables may be similarly processed for satellite, cable 
or Internet transmission, for example. 

20 Figure 18 is a block diagram of a digital video receiving 

system for demodulating and decoding broadcast (terrestrial, satellite, 
cable, or Internet) signals. In terrestrial mode, a carrier modulated 
with signals carrying program representative MPEG compatible audio, 
video and associated data received by antenna 10, is converted to 

25 digital form and processed by input processor 13. Processor 1 3 
includes radio frequency (RF) tuner and intermediate frequency (IF) 
mixer and amplification stages for down-converting the input signal 
to a lower frequency band suitable for further processing. In this 
exemplary system, the terrestrial input signal received by antenna 1 0 

30 contains 33 Physical Transmission Channels (PTCs 0-32). Each 
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Physical Transmission Channel (PTC) is allocated a 6 MHz bandwidth 
and contains, for example, up to 6 sub-channels. 

It is assumed for exemplary purposes that a video 
receiver user selects a sub-channel (SC) for viev/ing using remote 
5 control unit 70. Processor 60 uses the selection information provided 
from remote control unit 70 via interface 65 to appropriately 
configure the elements of decoder 100 to receive the PTC 
corresponding to the selected sub-channel SC Following down 
conversion, the output signal from unit 13 for the selected PTC has a 

10 bandwidth of 6 MHz and a center frequency in the range of 119-405 
MHz. In the following discussion, an RF channel or Physical 
Transmission Channel (PTC) refers to an allocated broadcaster 
transmission channel band which encompasses one or more sub- 
channels (also termed virtual or logical channels). 

15 Processor 60 configures the radio frequency (RF) tuner 

and intermediate frequency (IF) mixer and amplification stages of 
unit 13 to receive the selected PTC using bi-directional control and 
signal bus C. The down-converted frequency output for the selected 
PTC is demodulated by unit 15. The primary functions of demodulator 

20 15 are recovery and tracking of the carrier frequency, recovery of the 
transmitted data clock frequency, and recovery of the video data 
itself. Unit 15 also recovers sampling and synchronization clocks that 
correspond to transmitter clocks and are used for timing the 
operation of processor 13, demodulator 15 and decoder 17. The 

25 recovered output from unit 15 is provided to decoder 17. 

The output from demodulator 15 is mapped into byte 
length data segments, deinterleaved and Reed-Solomon error 
corrected according to known principles by unit 17. In addition, unit 
17 provides a Forward Error Correction (FEC) validity or lock 

30 indication to processor 60. Reed-Solomon error correction is a known 
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type of Forward Error Correction. The FEC lock indication signals that 
the Reed-Solomon error correction is synchronized to the data being 
corrected and is providing a valid output. It is to be noted that the 
demodulator and decoder functions implemented by units 13, 15 and 
5 17 are individually known and generally described, for example, in 
the reference text Digital Communication. Lee and Messerschmidt 
(Kluwer Academic Press, Boston, MA, USA, 1988). 

In other modes satellite, cable and Internet data is 
received on input lines 11, 14 and 18 and processed by interface 

10 access modules 74, 78 and 72 respectively. Interface modules 74, 7 8 
and 72 incorporate interface functions for satellite, cable and Internet 
format data respectively. Such functions are known and detailed in 
applicable standards and other documents. These interface functions 
correspond to those performed by units 13, 15 and 17 in terrestrial 

15 mode. Further, in similar fashion to terrestrial mode, processor 6 0 
configures units 74, 78, 72 and decoder 100 to receive satellite, cable 
or Internet data using bi-directional control and signal bus C. Decoder 
100 processes the data conditioned by units 74, 78 or 72 in these 
other modes using similar functions as described for terrestrial mode. 

20 The corrected output data from unit 17 is processed by 

MPEG compatible transport processor and demultiplexer 22. The 
individual packets that comprise either particular program channel 
content, or program specific information, are identified by their 
Packet Identifiers (PIDs). Processor 22 separates data according to 

25 type based on an analysis of Packet Identifiers (PIDs) contained 
within packet header information and provides synchronization and 
error indication information used in subsequent video, audio and data 
decompression. 

The corrected output data provided to processor 22 is in 

30 the form of a transport datastream containing program channel 
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content and program specific information for many programs 
distributed through several sub-channels. The program specific 
information in this exemplary description describes sub-channels 
present in a transport stream of a particular PTC. However, in another 
5 embodiment the program specific information may also describe sub- 
channels located in other PTCs and conveyed in different transport 
streams. Groups of these sub-channels may be associated in that their 
source is a particular broadcaster or they occupy the transmission 
bandwidth previously allocated to an analog NTSC compatible 

10 broadcast channel. Further, individual packets that comprise a 
selected program channel in the transport stream are identified and 
assembled by processor 60 operating in conjunction with processor 22 
using PIDs contained in the program specific information. 

The program specific information is acquired and 

15 assembled by processor 60, operating in conjunction with unit 22, 
from the datastream input from unit 17. Processor 60 determines 
from the FEC lock indication provided by unit 17 that valid data is 
being provided to transport processor 22. Thereupon, the program 
specific information MGT and AGDT tables are identified and 

20 assembled using predetermined PID values stored within processor 
60 internal memory. Using Control signal C, processor 60 configures 
transport processor 22 to select the data packets comprising the 
remaining program specific information including the CIT, HIT, ETT 
and NIT data. The program specific information tables may be 

25 acquired from a plurality of sources using the acquisition descriptor 
information previously described in connection with Figures 13 and 
14. The tables may be acquired by processor 60 initiating 
communication with different sources (e.g. satellite, cable, or Internet 
sources), in different data formats and transmission protocols via 

30 different transmission media such as via satellite feed 11, cable line 
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14 or phone line 18, The acquisition descriptor information, either 
alone or as supplemented by other program specific information, 
enables processor 60 to establish communication in different data 
formats and transmission protocols. This is achieved using interface 
5 units 72, 74 and 78 to establish either, uni-directional communication 
(e.g. for satellite communication), or bi-directional communication 
(e.g. for Internet communication). 

Processor 22 matches the PIDs (or other data identifiers 
e.g. TCP/IP identifiers, SCIDs etc.) of incoming packets provided b y 

10 unit 17 (or units 72, 74 and 78 for Internet, cable or satellite data 
sources) with PID values pre-loaded in control registers within unit 
22 by processor 60. Further, processor 60 accesses, parses and 
assembles the program specific information packets captured by 
processor 22 and stores the program specific information within its 

15 internal memory. Further, in response to a channel SC selection 
command from remote unit 70 via interface 65, processor 60 derives 
tuning parameters including PTC carrier frequency, demodulation 
characteristics, and sub-channel PIDs, from the acquired program 
specific information including location, acquisition and MOD 

20 descriptors. Processor 60 uses this information in configuring units 
13, 15, 17 and decoder 100 elements to acquire selected sub-channel 
(SC) program content. 

The packetized decoded transport stream input to decoder 
100 from unit 17 (or units 72, 74 or 78) contains video, audio and 

25 data representing TV programs, for example, and also contains sub- 
picture data. The sub-picture data contains picture elements 
associated with programs and channels selectable by a user for 
viewing including, multimedia objects, program guides, display 
commands, subtitling, selectable menu options or other items, for 

30 example. As such, the sub-picture data includes multimedia objects 
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acquired using MODs and an EIT containing descriptive lists of 
programs (events) receivable on the sub-channels listed in a CIT and 
also contains an ETT containing text messages describing programs 
and program sub-channels. 
5 The video, audio, data and sub-picture data being 

transmitted on terrestrial sub-channel SC, together with associated 
data from satellite, cable or Internet sources from units 74, 78 and 
72, is acquired by processor 60 operating in conjunction with unit 22. 
This is achieved using the collated program specific information 

10 including location and MOD descriptors. Processor 60 identifies the 
video, audio, data and sub-picture data using respective PIDs (or 
other identifiers) determined from the CIT and descriptors. Processor 
60 also initiates communication with other data sources (e.g. cable, 
satellite or Internet sources) in order to acquire video, audio, data and 

15 sub-picture data from these sources. Processor 60 and unit 2 2 
initiates the communication and identifies and captures the video, 
audio, data and sub-picture data from other sources using location 
descriptor information of the type previously described in connection 
with Figures 15 and 16. Similarly, processor 60 and unit 22 initiates 

20 communication and identifies and captures multimedia objects from 
other sources using MOD information of the type previously described 
in connection with Figures 6-12. The location descriptor and MOD 
information, either alone or as supplemented by other program 
specific information, enables processor 60 to establish communication 

25 in different data formats and transmission protocols. As previously 
explained, this is achieved using interface units 72, 74 and 78 to 
establish either, uni-directional communication (e.g. in the satellite 
communication mode), or bi-directional communication (e.g. in cable 
or Internet communication mode). 
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Processor 22, matches the PIDs (or other identifiers) of 
incoming packets provided by decoder 17 and interface units 72, 7 4 
and 78 with identifier values of the video, audio and sub-picture data 
being transmitted on sub-channel SC and also being input via 
5 communication lines 11, 14 and 18. In this manner, processor 2 2 
captures packets constituting the program transmitted on sub- 
channel SC and associated data and multimedia objects (e.g. 
advertisements, web page data, interactive icons etc.). Processor 2 2 
forms these packets into MPEG compatible video, audio and sub- 

10 picture streams for output to video decoder 25, audio decoder 35 and 
sub-picture processor 30 respectively. The video and audio streams 
contain compressed video and audio data representing the selected 
sub-channel SC program content. The sub-picture data contains 
multimedia objects and EIT and ETT information associated with the 

15 sub-channel SC program content and program guide information. 

Decoder 25 decodes and decompresses the MPEG 
compatible packetized video data from unit 22 and provides 
decompressed program representative pixel data to NTSC encoder 4 5 
via multiplexer 40. Similarly, audio processor 35 decodes the 

20 packetized audio data from unit 22 and provides decoded and 
amplified audio data, synchronized with the associated decompressed 
video data, to device 55 for audio reproduction. Processor 30 decodes 
and decompresses sub-picture data including multimedia objects 
received from unit 22 to provide image representative multimedia 

25 object, text, caption and graphics data. In decoding multimedia 
objects, processor 30 applies a decoding function determined using 
the associated MOD information elements exemplified in Figures 6 and 

Processor 30 (Figure 18) assembles and formats the 
30 decoded and decompressed multimedia object, text, caption and 
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graphics data for output to On-Screen Display (OSD) and graphics 
generator 37. In formatting decoded multimedia objects, processor 3 0 
(in conjunction with unit 37), under direction of unit 60, determines 
how, where, and when individual objects are to be displayed from 
5 MOD information (or equivalent elements) such as object,format, 
display_mode, object_start_time, object_duration, object_frame_.size 
as shown in Figures 6 and 7, for example. An individual object may 
also be linked to other program or program guide images by 
processor 30 using linkage and attribute descriptors, for example 

10 (items 825 and 840 of Figures 8 and 9). Alternatively, other 
descriptors and descriptor elements performing a similar linkage 
function may be employed. A multimedia object may also be linked 
with particular sub-channels, program images, scenes or program 
guide pages or web pages, for example, by incorporating MOD 

15 descriptor information into an HIT or CIT or other table. In this 
method, an object is directly linked to a program image (or sub- 
channel, scene or program guide or web page image) by association 
with descriptive elements of the program within the EIT or CIT, 

Unit 37 of Figure 18 interprets and formats the 

20 multimedia objects and other data from unit 30 using the linkage and 
formatting information (as described in connection with processor 3 0 
above) of Figures 6 and 8 as supplemented by CIT and EIT 
information and generates formatted pixel mapped text and graphics 
for presentation on unit 50 (Figure 18). The formatted pixel mapped 

25 text and graphics data may represent multimedia objects or a 
program guide or other type of menu or user interface for subsequent 
display on unit 50, Unit 37 also processes EIT, ETT and other 
information to generate pixel mapped data representing, subtitling, 
control and information menu displays including selectable menu 

30 options, and other items, for presentation on unit 50, The control and 
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information displays enable function selection and entry of device 
operating parameters for User operation of decoder 100, 

The text and graphics produced by OSD generator 37 are 
generated in the form of overlay pixel map data under direction of 
5 processor 60. The overlay pixel map data from unit 37 is combined 
and synchronized with the decompressed pixel representative data 
from MPEG decoder 25 in encoder 45 via multiplexer 40 under 
direction of processor 60. Thereby multimedia objects such as 
advertisements, web page data, interactive icons etc. may be included 

10 in program content or program guides for display. Combined pixel 
map data representing a video program and associated multimedia 
objects together with associated sub-picture text message data is 
encoded by NTSC encoder 45 and output to device 50 for display. 

In a storage mode of the system of Figure 18, the 

15 corrected output data from unit 17 is processed by decoder 100 to 
provide an MPEG compatible datastream for storage. In this mode, a 
program is selected for storage by a user via remote unit 70 and 
interface 65. Processor 22, in conjunction with processor 60 forms 
condensed program specific information including MGT, AGDT, CIT, 

20 BIT and ETT data and location, acquisition and multimedia object 
descriptors containing the advantageous features previously 
described. The condensed program specific information supports 
decoding of the program selected for storage but excludes unrelated 
information. Processor 60, in conjunction with processor 22 forms a 

25 composite MPEG compatible datastream containing packetized content 
data of the selected program and associated condensed program 
specific information. The composite datastream is output to storage 
interface 95. 

Storage interface 95 buffers the composite datastream to 
30 reduce gaps and bit rate variation in the data. The resultant buffered 
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data is processed by storage device 90 to be suitable for storage on 
medium 105. Storage device 90 encodes the buffered datastream 
from interface 95 using known error encoding techniques such as 
channel coding, interleaving and Reed Solomon encoding to produce 
5 an encoded datastream suitable for storage. Unit 90 stores the 
resultant encoded datastream incorporating the condensed program 
specific information on medium 105. 

The architecture of Figure 18 is not exclusive. Other 
architectures may be derived in accordance with the principles of the 

10 invention to accomplish the same objectives. Further, the functions of 
the elements of decoder 100 of Figure 18 and the process steps of 
Figure 17 may be implemented in whole or in part within the 
programmed instructions of a microprocessor. In addition, the 
principles of the invention apply to any form of MPEG or non-MPEG 

15 compatible electronic program guide. A datastream formed according 
to the invention principles may be used in a variety of applications 
including video server or PC type communication via telephone lines, 
for example. A program datastream with one or more components of 
video, audio and data formed to incorporate program specific 

20 information according to invention principles may be recorded on a 
storage medium and transmitted or re-broadcast to other servers, PCs 
or receivers. 
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CLAIMS 



1 . Apparatus for decoding packetized program information from a 
5 first source to provide data content of a program, comprising: 

means for identifying (22,60) ancillary information in said packetized 
program information, said ancillary information including information describing a 
multimedia object associated with an image in said packetized program 
information, said multimedia object description information comprising, 
10 (a) a location indicator (610) identifying a location of a 

multimedia object for use in acquiring said multimedia object, and 

(b) a type indicator (605) identifying a multimedia object type 
for use in decoding said multimedia object; and 

means for acquiring and decoding (22, 30, 60) said multimedia 
15 object using said multimedia object description information; and 

means for formatting (30, 37, 60) said multimedia object for 

display. 

2. Apparatus according to claim 1, wherein 

20 said location indicator identifies a location of said multimedia object 

in one of (a) said packetized program information from said first source, and (b) 
information derived from a second source different to said first source. 

3. Apparatus according to claim 2, wherein 

25 said location indicator identifies a location of said multimedia object 

derived from said first source using one of (a) an MPEG compatible packet 
Identifier (PID), (b) an MPEG compatible Digital Storage Media code. 

4. Apparatus according to claim 2, wherein 

30 said location indicator identifies a location of said multimedia object 

derived from said second source using one of (a) an Internet URL, (b) an Internet 
IP address, (c) an Email address, (d) a telephone/fax/videophone number. 

5. Apparatus according to claim 4, wherein 

35 said means for acquiring said multimedia object includes establishing 

bi-directional communication with said second source using said location 
indicator, and said bi-directional communication path vis different to the 
communication path between said decoding apparatus and said first source. 



mBmm sheet 



23 



6. Apparatus according to claim 1, wherein 

said multimedia object type comprises at least one of, (a) a video 
segment or still image, (b) an audio segment, (c) text, (d) an Internet web page 
or Internet data, (e) an advertisement, (f) an icon for user selection of a service, 
(g) an animation segment, (h) an Email message, (i) a user prompting indicator, 
and (j) a broadcast channel identification icon. 



7. Apparatus according to claim 1, wherein 
10 said multimedia object description information further includes at 

least one of, (a) an object start time, (b) an object duration, (c) an object display 
mode, (d) an object version number, (e) an object format, for use in decoding. 



8. Apparatus according to claim 1, wherein 

15 said formatting means includes means for associating said 

multimedia object with one of (a) a video image, and (b) audio data, and 

said formatting means forms a composite image for display 
combining said multimedia object and at least one of, (a) an electronic program 
guide, (b) a video program, and (c) an Internet web page image. 

20 

9. Apparatus according to claim 1, wherein 

said ancillary information comprises program specific information for 
conveying an electronic program guide from said first source, and wherein 

said multimedia object is associated with said electronic program 

25 guide, 

10. A storage medium containing digital data representing video 
information comprising: . 

packetized program information representing a video program; and 
30 ancillary information (205, 210, 215, 220) including information 

describing a multimedia object associated with an image in said packetized 
program information, said multimedia object description information comprising, 

(a) a location indicator (610) identifying a location of said 
multimedia object for use in acquiring said multimedia object, and 
35 (b) a type indicator (605) identifying a multimedia object type 

for use in decoding said multimedia object; and 

information (215; 825; 840) for associating said multimedia object 
with an image in said packetized program information. 
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1 1 . A storage medium according to claim 10, wherein 

said ancillary information comprises program specific information 

containing an electronic program guide, and wherein 
5 said multimedia object is associated with said electronic program 

guide. 

12. A method for forming program guide information at a first 
source suitable for decoding packetized program information to provide data 

10 content of a program, comprising the steps of: 

forming information describing a multimedia object associated with 
an image in said packetized program information, said multimedia object 
description information comprising, 

(a) a location indicator identifying a location of a multimedia 
15 object for use in acquiring said multimedia object, and 

(b) a type indicator identifying a multimedia object type for 
use in decoding said multimedia object; and 

forming linking information associating said multimedia object with 
an image in said packetized program information; and 
20 incorporating said multimedia object description information and said 

linking information into packetized data for output to a transmission channel. 

13. A method according to claim 12, wherein 

said location indicator identifies a location of said multimedia object 
25 in one of (a) said packetized program information from said first source, and (b) 
information derived from a second source different to said first source. 

14. A method according to claim 13, wherein 

said location indicator identifies a location of said multimedia object 
30 from said first source using one of (a) an MPEG compatible packet Identifier 
(PiD), (b) an MPEG compatible Digital Storage Media code. 

15. A method according to claim 13, wherein 

said location indicator identifies a location of said multimedia object 
35 derived from said second source using one of (a) an Internet URL, (b) an Internet 
IP address, (c) an Email address, (d) a telephone/fax/videophone number. 
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* 1 6. A method according to ciaim 1 5, wherein 
said multimedia object type comprises at least one of, (a) a video 
segment or still image, (b) an audio segment, (c) text, (d) an Internet web page 
5 or Internet data, (e) an advertisement, (f) an icon for user selection of a service, 
(g) an animation segment, (h) an Email message, (i) a user prompting indicator, 
and (j) a broadcast channel identification icon. 

1 7. A method according to claim 1 2, wherein 
10 said multimedia object description information further includes at 

least one of, (a) an object start time, (b) an object duration, (c) an object display 
mode, (d) an object version number, (e) an object format, for use in decoding. 

1 8. A method according to claim 1 2, wherein 
15 said linking information associates said multimedia object with at 

least one of, (a) an electronic program guide, (b) a video program, (c) an audio 
program and (d) an Internet web page image. 



9 



19. A method for decoding packetized program information to 
20 provide data content of a program, comprising the steps of: 

identifying ancillary information in said packetized program 
information, said ancillary information including information describing a 
multimedia object associated with an image in said packetized program 
information, said multimedia object description information comprising, 
25 (a) a location indicator identifying a location of a multimedia 

object for use in acquiring said multimedia object, and 

(b) a type indicator identifying a multimedia object type for 
use in decoding said multimedia object; and. 

acquiring and decoding said multimedia object using said multimedia 
30 object description information; and 

formatting said multimedia object for display. 



20. A method according to claim 1 9, including the step of 
associating said multimedia object with one of (a) a video image, 
35 and (b) audio data. 
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21 . A method according to claim 20, including the step of 
forming a composite image for display combining said multimedia 

object and at least one of; (a) an electronic program guide, (b) a video program, 
5 and (c) an Internet web page image. 

22. Apparatus for decoding packetized program information from a 
firsts-source to provide data content of a program, comprising: 

means for identifying ancillary information in said packetized 
10 program information, said ancillary information including information describing a 
method associated with a multimedia object in said packetized program 
information, said method description information comprising, 

(a) information enabling identification of a method, and 

(b) information for initiating activation of said method upon a 
15 predetermined event; and 

means for acquiring and decoding said method using said method 
description information; and 

means for initiating activation of said method upon said 
predetermined event using said method description information, 

20 

23. Apparatus according to claim 22, wherein 

said method comprises software for performing at least one of the 
following functions, (a) altering user interface display controls, (b) generating an 
image window within an encompassing image (c) generating an HTML or SGML 
25 document (d) generating a menu of selectable items (e) generating an icon 
representing a user selectable item for display, (f) generating an image window 
for initiating Internet access, (g) generating an image window supporting an 
electronic commerce transaction, and (h) dialing a telephone number. 

30 24. Apparatus according to claim 23, wherein altering user interface 

display controls comprises modifying at least one of 

(a) keyboard/mouse button response characteristics, (b) display 
video characteristics, and (c) audio characteristics. 

35 25. Apparatus according to claim 22, wherein 

said method comprises software for at least one of, 

(a) providing descriptive text for said image object, and 

(b) providing at least one user selectable control item 
associated with said image object. 

40 
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26. Apparatus according to claim 22, wherein o,' 
said information for initiating activation of said method upon a 
predetermined event comprises information for at least one of, (a) activating said 
method in response to user selection of a command or displayed menu item, (b) 
5 activating said method in response to a scheduled event, (c) activating said 
method in sequence following completion of a particular function, and (d) 
activating said method substantially immediately said method is processed and 
ready for activation. 

10 27. Apparatus according to claim 26, wherein 

said information for initiating activation of said method upon a 
scheduled event comprises a start time indication. 

28. Apparatus according to claim 27, wherein 

15 said start time indication is associated with a specific video program 

and is derived from electronic program guide information. 

29. Apparatus according to claim 27, wherein 

said information for initiating activation of said method further 
20 includes a duration. 

30. Apparatus according to claim 22, wherein 

said ancillary information includes electronic program guide 
information from said first source. 

25 

31 . Apparatus according to claim 27, wherein 

said ancillary information further includes information for acquiring 
said method from said first source comprising, 

a data identifier for identifying a location of said method conveyed 
30 within said packetized program information from said first source, 

32. Apparatus according to claim 22, wherein 

said ancillary information further includes acquisition information for 
use in acquiring said method from a second source different to said first source, 
35 and 

said acquisition information includes one of (a) an Internet URL, (b) 
an Fnternet IP address, (c) an Email address, and (d) a telephone/fax/videophone 
number. 
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33. Apparatus according to claim 32, where'm 

said means for acquiring said method includes establishing bi- 
directional communication with said second source using said acquisition 
5 information, and said bi-directional communication path is different to the 
communication path between said decoding apparatus and said first source. 



34. Apparatus according to claim 22, including 

formatting means for forming a composite image for display 
10 combining an image produced using said method and at least one of, (a) an 
electronic program guide, (b) a video program, and (c) an Internet web page 
image. 



35. A storage medium containing digital data representing video 
15 information comprising: 

packetized program information representing a video program; and 
ancillary information including information describing a method 
associated with a multimedia object in said packetized program information, said 
method description information comprising, 
20 (a) information enabling identification of a method, and 

(b) information for initiating activation of said method upon a 
predetermined event; and 

information for associating said method with a multimedia object in 
said packetized program information. 

25 

36. A storage medium according to claim 35, wherein 

said ancillary information includes electronic program guide 
information, and wherein 

said method is associated with said electronic program guide. 

30 
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37. A method for forming program guide information at a first 
source suitable for decoding packetized program information to provide data 
content of a program, comprising the steps of: 

forming information describing a method associated with one or 
more images in said packetized program information, said method description 
information comprising, 

(a) information enabling identification of a method, and 

(b) information for initiating activation of said method upon a 
predetermined event; and 

forming linking information associating said method with an image 
in said packetized program information; and 

incorporating said method description information and said linking 
information into packetized data for output to a transmission channel. 

38. A method according to claim 37, wherein 

said method identification information identifies a location of said 
method in said packetized program information from said first source. 



method from a second source different to said first source using one of (a) an 
Internet URL, (b) an Internet IP address, (c) an Email address, (d) a 
teiephone/fax/videophone number. 

40. A method according to claim 37, wherein 

said linking information associates said method with at least one of, 
(a) an electronic program guide, (b) a video program, (c) an audio program and (d) 
an internet web page image. 



39. A method according to claim 37, wherein 

said method description information includes data for acquiring said 
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41 . A method for processing packetized program information to 
provide data content of a program, comprising the steps of: 

identifying ancillary information in said packetized program 
5 information, said ancillary information including information describing a method 
associated with one or more images in said packetized program information, said 
me^od description information comprising, 

(a) information enablmg identification 6f a method, and 

(b) information for initiating activation of said method upon a 
10 predetermined event; and 

acquiring and decoding said method using said method description 
information; and 

initiating activation of said method upon said predetermined event 
using said method description information. 

15 

42. A method according to claim 41, wherein said acquiring step 

comprises 

acquiring said method from a second source different to said first 
source, using one of (a) an Internet URL, (b) an Internet IP address, (c) an Email 
20 address, and (d) a telephone/fax/videophone number. 



43. A method according to claim 41, wherein said initiating 
activation step comprises 

initiating activation of said method by at least one of, (a) activating 
25 said method in response to user selection of a command or displayed menu item, 
(b) activating said method in response to a scheduled event, (c) activating said 
method in sequence following completion of a particular function, and (d) 
activating said method substantially immediately said method is processed and 
ready for activation. 



AMtUDED SHEET 



37 " ~ ■ - : , ^' ■ 

44. A method for processing packetized program infornnation from a 
first source to provide data content of a program, comprising the steps of: 

identifying ancillary information in said packetized program 
information, said ancillary information including, 

(a) a first identifier for identifying a location of data 
representing a multimedia object, and 

(b) a second identifier for identifying a location of data 
representing program guide information, and 

(c) a third identifier for identifying a location of data 
representing a video program in said packetized program information, and 

acquiring and decoding said multimedia object, said program guide 
information and said video program data using said ancillary information; and 
formatting acquired data for display. 

45. A method according to claim 44, wherein said ancillary 
information further includes 

(d) a fourth identifier for identifying a location of data 
representing a method. 

46. A method according to claim 44, wherein said said first, 
second and third identifiers identify a location of said multimedia object in either 
one of (a) said packetized program information from said first source, and (b) 
information derived from a second source different to said first source. 

47. A method according to claim 46, wherein said information is 
derived from said second source different to said first source using one of (a) an 
Internet URL, (b) an Internet IP address, (c) an Email address, (d) a 
telephone/fax/videophone number. 

48. A method according to claim 44, wherein said formatting step 
includes the steps of 

associating said multimedia object with one of (a) a video image, 
and (b) audio data, and 

forming a composite image for display combining said multimedia object 
and at least one of, (a) an electronic program guide, (b) a video program, and (c) 
an Internet web page image. 
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SYNTAX 


BITS 


FORMAT 


300- 


MGT message {) { 

reservecf 

lifejime 

current time 

Num bytes AGDT 
} " ~ 


2 

22 
40 
16 


11' 

uimsbf 
uimsbf 
uimsbf 



FIG. 3 



SYNTAX 



BITS 



FORMAT 



410- 
415- 



AGDT_message () { 
reserved 
CCT_version 
reserved 

EPG_descriptors_length 
for (i=0;i<N;i++) { 
— descriptor () 

num_bytes_CCT 
number_of_networks 
for {i = 0 ; i < number_of_networks; i++){ 
reserved 
NIT_version 
num_bytes_NIT[i] 
reserved 

network_descriptors_length 
for (i=0;i<N;i++ { 
descriptor () 



} 



} 



program_guide_map () 



3 


111' 


5 


uimsbf 


4 


1111' 


12 


uimsbf 


var 




16 


uimsbf 


8 


uimsbf 


3 


111' 


5 


uimsbf 


16 


uimsbf 


4 


1111' 


12 


uimsbf 



var 
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SYNTAX 



BITS 



FORMAT 



program_guide_map () { 
number_channel_groupings 
SPG_map_clescriptors_length 
for(i=0;l<N;i++){ 
descriptor (} 



510 



for (i = 0;l<nufnber_channel groupings+1;i++) { 
reserved 
starl_cfiannel(i) 



numberjuides 
reserved 

program_puide_map_size 
- for (i = 0; i< number_guides+1;i++} SPG_map(i) ( 

next 

previous 

ieft_columnJme 

widtlijn.minutes 

reserved 

SPGJescriptorsJengtli 
for(i=0;i<N;[f+j{ 
— descriptor (} 

ljbytes_list_SPG(i)( 

for (j = 0;j< number_channel_grouplngs+1 ;j++) 
reserved 

groupOLdescriptors length 
for(l=D;l<N;l++5{ " 
— • descriptor 0 

Lm_bytes_SPG[i 
Num_bytes_SPGi 
Num_bytes SPG ' 
Num bytes SPG' 



jrEEil] 



SPG_name_length 
for(i=0;i< SPG_nameJength;i++) 
SPG name(i) 



4 
12 

var 



4 
12 

8 
4 
12 

8 
8 

40 
16 
4 
12 

var 



4 
12 

var 

16 
16 
16 
16 



8 
8 



uimsbf 
uimsbf 



'1111' 
uimsbf 

uimsbf 

'1111' 

uimsbf 

uimsbf 

uimsbf 

bslbf 

uimsbf 

'1111' 

uimsbf 



'1111' 
uimsbf 



uimsbf 
uimsbf 
uimsbf 
uimsbf 



uimsbf 
ISO-639 
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SYNTAX BITS FORMAT 

multimedia object {jescriptor(){ 

descrlptorjag 8 0x5F 

descriptorjength 8 uimsbf 

-object_type 8 uimsbf 
if (object .type = OxFF}{ 

extended_object_type 16 uimsbf 

' address_descriptor 

objectjormat 8 uimsbf 

object_version_nuniber 7 uimsbf 

disptay_mode 1 o/1 

objectjtartjme 40 uimsbf 

objectjurationjormat 2 uimsbf 

objectjuration 14 uimsbf 

objectJrame_size 32 uimsbf 
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rating_decriptor 

ca_descriptor 

te!ephone_descriptor 

method_descriptor 

linkage_descriptor 

URL_descriptor 

emaiLaddress_descriptor 

attribute_descriptor 

just_in_time_object descriptor 

content_descriptor 



FIG. 8 



ELEMENT 


DEFINITION 


rating_descriptor 


THE ratingjescriptor SPECIFIES THE PARENTAL RATING FOR THE OBJECT. 


cajescriptor 


THE ca.descriptor SPECIFIES THE CONDITIONAL ACCESS 
SYSTEM FOR THE OBJECT. 


te!ephone_descriptor 


THE telephonejescrlptor SPECIFIES THE TELEPHONE NUMBER AND 
REUTED INFORMATION ASSOCIATED WITH THE OBJECT. 


method_descriptor 


THE method.descriptors ASSOCIATED WITH AN OBJECT DESCRIBE THE 
METHODS AND THE EVENTS THAT WILL TRIGGER THEM. 


linkage_descriptor 


THE linkagejescriptor LINKS OTHER DESCRIPTORS TO THE CURRENT 
OBJECT DESCRIPTOR. 


attribute.descriptor 


THE attribute.descriptor SHALL BE USED TO SPECIFY THE SPECIAL 
ATTRIBUTES OF THE CURRENT OBJECT, 


justinJime_object descriptor 


THIS DESCRIPTOR IS USED TO INDICATE THE ADDRESS OF THE MODs 
AND OBJECTS THAT ARE NOT KNOWN IN ADVANCE. 


content_descriptor 


THIS DESCRIPTOR IS USED TO SPECIFY THE OBJECTS PROFILE VALUES 
FOR TARGETTED COMMERCIALS. 


FIG. 9 
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SYNTAX 


BITS 


FORMAT 


remote_http_ob|ect_address_clescriptor() { 
descriptor tag 
descriptor length 
URL length 

for (i = 0;i<URL length;i++) { 

-URL(i) 

} 

} 


8 
8 
8 

8 


uimsbf 
uimsbf 
uimsbf 

ISO-639 


FIG. 10 


SYNTAX 


BITS 


FORMAT 


DSM-CC_object_address_descriptor() { 
descriptorjag 
descriptorjength 
~ DSM-CC_association_tag 


8 
8 
16 


uimsbf 
uimsbf 
uimsbf 


FIG. 11 


SYNTAX 


BITS 


FORMAT 



925 
930- 



MPEG_PSLPS_address_descriptor{){ 
descriptorjag 
descriptorjength 
default jDrimary_location_bit 
if (default_primary_location_bit == 0 ) { 

- network Jd 

- transport_channel_id 

default_secondary_location_bit 
if (defauit_secondary location blt==0){ 
— PID 
table_id 

tabie_id_extension 

} 



8 


uimsbf 


8 


uimsbf 


1 


0/1 


8 


uimsbf 


8 


uimsbf 


1 


0/1 


13 


uimsbf 


8 


uimsbf 


16 


uimsbf 
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SYNTAX 



BITS 



FORMAT 



descriptorjag 
descriptor_iength 
-number_eiements 
for (i=0;i<number_elements;i++) { 
reserved 
sizejiag 
-^elementjdentifier 

if (transport == broadcast) { 
transport_channe!_ID 
reserved 
PID 

} 

else if (transport == file based) { 
file_name_length 
for (i=0;i<addressJength;i++) 
file_char 

} 

if (size_ftag== 1){ 
element size 



8 
8 
8 

3 
1 

12 

8 
3 

13 



8 
8 

32 



uimsbf 
uimsbf 
uimsbf 

'111' 

uimsbf 

uimsbf 

uimsbf 

'111' 

uimsbf 



uimsbf 
ISO-639 

uimsbf 



FIG. 13 



element_identifier 


description 


0x000 


user private 


0x001 


Private Information Parcel (PIP) 


0x002 


Extended Text Table (ETT) 


0x003 


Network Infomiation Table (NIT) 


0x004 


Special Program Guide (SPG) 


0x005 


Channel Infonnation Table (CIT) 


0x006 


Extented Channel information Table (ECIT) 


0x007 


Event Information Table (EIT) 


0x008 


Extended Event Information Table (EEIT) 
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SYNTAX 

location_descriptor () { 
— descriptorjag 
descriptor_length 
number_PIDs 
reserved 
implicitjiag 

if (implicitjiag = OxOO){ 

-for (i=1 ;i<number_PIDs;l++){ 
reserved 
-PID[i] 
^ SType[l] 

} else { 
reserved 
~base_PID 

} 



BITS 



8 
8 
8 
7 

1 



3 

13 
8 



3 

13 



FORMAT 



uimsbf 

uimsbf 

uimsbf 

1111111' 

bslbf 



'111' 

uimsbf 

uimsbf 



'111' 
uimsbf 
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SYNTAX 

iocation_clescriptor {) { 
-~ — descriptorjag 

descriptorjength 

number_SCIDs 

reserved 

2_bit 

implicitjiag 

if (impliciLflag == OxOOK 

for(i=1;i<number sCIDs;i++){ 
if(Z_bit==0) " 
_-^SCID[i] 
else{ 

reserved 
-SCID[i] 



} 



;Type[i] 



} else { 

if {Z_bit==0) 

■ base_SCID 
eise{ 
reserved 
■base SCID 



) 



} 



BITS 



8 
8 
8 
6 
1 
1 



8 

4 
12 

8 



8 

4 
12 



FORMAT 



uimsbf 

uimsbf 

uimsbf 

'111111' 

bslbf 

bslbf 



uimsbf 

'1111' 
uimsbf 

uimsbf 



uimsbf 

'1111' 
uimsbf 
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^start) 



DEFINE A METHOD TO PARTITION GUIDE DATA. 
PARTITIONS ARE BASED ON COMBINATIONS OF 

- NETWORK Ti'PES 
-TIME SEGMENTS 
-CHANNEL GROUPS 

• CHANNELS IN A TRANSPORT STREAM 

- EVENTS (TV PROGRAMS) ASSOCIATED TO A CHANNEL 



I 



255- 



257- 



DEFINE THE LOCATIONS OF THE PARTITION TABLES AND 
OBJECTS. DEFINE THE DESCRIPTORS THAT WILL INDICATE 
THE LOCATIONS OF THOSE TABLES AND OBJECTS. 



GENERATE A CONTROL TABLE SUCH AS THE AGDT. 
INCLUDE THE NECESSARY AQUISITION DESCRIPTORS 
AND MULTIMEDIA OBJECT DESCRIPTORS. 



260- 



GENERATE THE TABLES APPLICABLE TO A PARTICULAR 
PARTITION {EXAMPLES : NIT, CIT, EIT, ECIT, EEIT, ETT, ETC.) 
INCLUDE DESCRIPTORS AS NECESSARY: 



-ACQUISITION DESCRIPTORS 

• MULTIMEDIA OBJECT DESCRIPTORS 

-LOCATION DESCRIPTORS 



T 



263- 



FORMAT TABLES AND OBJECTS ACCORDING TO THE MEDIA 
AND PROTOCOL SELECTED FOR DELIVERY. EXAMPLES ARE 

- MPEG-2PSi 

-MPEG-2DSM-CC 

-DSS TRANSPORT STREAM 

-RLES FOR INTERNET ACCESS 



265- 



267- 



INCORPORATE TABLES AND OBJECTS INTO THEIR 
RESPECTIVE LOCATIONS FOR TRANSMISSION 
(TERRESTRIAL, DSS) OR ACCESS (INTERNET). 



T 



INCORPORATE CONTROL TABLE INTO THE MAIN 
DELIVERY MEDIA. 



270- 



MULTIPLEX BITSTREAMS WITH AUDIO, VIDEO, 
AND OTHER DATA. TRANSMIT INFORMATION. 



275- 



END ) 



FIG. 17 
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for patent or inventor's certificate or of any PCT international application(s) designating at least one country 
other than the United States of America listed below and have also identified below any foreign application(s) 
for patent or inventor's certificate or any PCT international application(s) designating at least one country other 
than the United States of America filed by me on the same subject matter having a filing date before that of the 
application(s) of which priority is claimed: 



PRIOR FOREIGM/PCT APPUCATIOIM(S) AND ANY PRIORITY CLAIMS UNDER 35 U.S.C. 1 1 9: 



COUNTRY 
(if PCT, indicate PCT") 


APPLICATION NUMBER 


DATE OF FILING 
{day, month, year) 


PRtORiTY CLAIMED 
UNDER 35 use 119 








□ YES □ NO 








□ YES □ NO 








□ YES □ NO 








□ YES □ NO 








□ YES □ NO 



Page 1 o5C 3 U.S. OEPARTIVIENT OF COMMERCE-Patent and Trademark Offic 



Combined Declaration For Patent Application and f^owtr of A^orney (Continued) 

(Inciudes Reference to PCT international Applications) ' 



ATTORNEY'S DOCK^NUMBER 

RCA 8^5759 > 



I hereby claim the. benefit under Title 35, United States Code, §120 of any United States application(s) or PCT 
international application(s) designating the United States of America that is/are listed below and, insofar as the 
subject matter of each of the claims of this application is not disclosed in that/those prior application(s) in the 
manner provided by the first paragraph of Title 35, United States Code, §112, I acknowlege the duty to disclose 
material information as defined in Title 37, Code of Federal Regulations, § 1.56(a) which occurred between the 
filing date of the prior application(s) and the national or PCT international filing date of this application: 



c u s APPLICATIONS OR PCT INTERNATIONAL APPLICATIONS DESIGNATING THE U.S. FOR BENEFIT UNDER 



U S. APPLICATiONS 


STATUS {Check one) 


U S APPUCATIQN NUMBER 


U S FILING DATE 


PATENTED 


PENDING 


ABANDONED 


60/061897 


14 October 1997 (14.10.97) 




























PCT APPUCATIONS DESIGNATING THE U.S 








PCT APPLICATION NO 


PCT FILING DATE 


us SERIAL NUMBERS 
ASSIGNED Of any} 








PCT/US98/21556 


130ctober 1998 (1 


3.10. 98) 

































POWER OF ATTORNEY: As a nanfied inventor, I hereby appoint the following attorney{s) and/or agent(s) to prosecute 
this application and transact ail business in the Patent and Trademark Office connected therewith. {List name and registra- 
tion number) Joseph S. Tripoli - Reg. No. 26, 040 

Eric P. Herrmann - Reg. No. 29,169 

Alexander J. Burke - Reg. No. 40,425 



Send Correspondence to: 

J oseph S. Tripoli - Pa-hen-h Op ^-r^i-H nnct 

THOMSON mu ltim edia Licensing In c . 

PQ Box 531^ ' 

Pr1nn^txyn_r Npw .T<argp>y n«R 40 us , 



Direct Telephone Calls to: 

(name and telephone number} 



1-609-734-9503 



m 


FULL NAME 
OF INVENTOR 


FAMILY NAME 
„. EBLING 


FIRST GIVEN NAME 

,_Mark 


SECOND GIVEN NAME 

Jacob 


a' 


RESIDENCE & 
CITIZENSHIP 


Indianapolis, JJA/ 


STATE OR FOREIGN COUNTRY 

Indiana 


COUNTRY OF CITIZENSHIP 

US 




POST OFFICE 
ADDRESS 


POST OFFICE ADDRESS 

6709 Stearns Hill Drive 


CITY 

i Indianapolis 


STATE & ZIP CODE/COUNTRY 

Indiana 46237 US 




FULL NAME 
OF INVENTOR 


FAMILY NAME 

HEREDIA 


FIRST GIVEN NAME 

Edwin 


SECOND GIVEN NAME 

Arturo 


CN 
O 
CN 


RESIDENCE & 
CITIZENSHIP 


CITY 

San Jose 


^TATE OR FOREIGN COUNTRY 

California 


COUNTRY OF' CITIZENSHIP 

Boliva 




POST OFFICE 
ADDRESS 


POSTOFFICEADDRESS-L^QQ NOrth 

First Street # 235 


CITY 

_San Jose 


STATE & ZIP CODE/COUNTRV 

California 95112 US 




FULL NAME 
OF INVENTOR 


FAMILY NAME 
N I RAN JAN 


FIRST GIVEN NAME 

Sithampara 


SECOND GIVEN NAME 


CO 
O 
CN 


RESIDENCE & 
CITIZENSHIP 


CITY 

Redwood Shores 


STATE OR FOREIGN COUNTRY 

California 


COUNTRY OF CITIZENSHIP 
LK 




POST OFFICE 
ADDRESS 


POST OFFICE ADDRESS 

613 Canoe Court 


CITY 

Redwood Shores 


STATE & ZIP CODE/COUNTRY 

California 94065 US 



I hereby declare that all statements made herein of my own knowledge are true and that all statements made on 
information and belief are believed to be true; and further that these statements were made with the knowledge 
that willful false statements and the like so made are punishable by fine or imprisonment, or both, under section 
1001 of Title 18 of the United States Code, and that such willful false statements may jeopardize the validity of 
the application or any patent issuing thereon. 



X 



SIGNATURE OF INVENTOR 201 

Mark J^ob Eblinc 





SIGNATURE OF INVENTOR 202 

Edwin Arturo H^edia 




SIGNATURE OF INVENTOR 203 



Sithamparaxfiiiran j an 



3- IS 

2000 



DATE 



DATE 



2000 



2000 



PTO-1391 (REV. 10-83) 
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U S, DEPARTMENT OF COMMERCE-Patent and Trademark Offic^ 



RCA 88759 



COMBINED DECLARATION FOR PATENT APPLICATION AND POWER OF ATTORNEY 

(Continued) 





FULL NAM6 
OF INVENTOfl 


FAMILY NAMi 
TENG 


FMSTGIVCMNAMt 

CHIA-YUAN 


SKOND GIVEN NAME 


o 


RESlOCNCE ft 
CITIZENSHIP 


CITY 

San Diego 


sTATt oniomcm axmntt 

California 


tOOttrm Of CITIZENSHIP 

Taiwan 




POST OFFICE 
AOOACSS 


POST OFFsCE AOORESS 

7384 Celata Lane 


CITY 

San Diego 


STATE & ZIP CODE/COUNTRY 

California 92129 US 




FULL NAMC 
OF INVENTOR 


Family name 
OZKAN 


FiflST GIVEN NAMC 

Mehmet 


SECOND GIVEN NAMC 

Kemal 


m 

m 


CITIZENSHIP 


OTV 

Istanbul 


,TA T£ OR FOREIGN COUNTRY 

Turkey 


COUNTRY Of OTIZENSMP 

TR 




POST OFFICE 
A00AE5S 


POST OFFICE AooREss Savasci SOK. 
Bozokatt 19/1 Avcilar 


CITY 

Istanbul 


STATE & ZIP COOE/COUNTRY 

34840 TR 




FULL NAMe 
OF INVENTOR 


FAMILY NAME 

SAEGER 


FIRST OIVEN NAMC 

Timothy 


SECOND GIV€N NAME 

William 


E 


AESIOENCEft 
CITIZ£NSH# 


OTV 

Carmel 


STATE OR FOREIGN COUNTRY 

Indiana 


COUNTRY OF OTIZENSMP 

US 




POST OFFICE 
A00AE5S 


POST OFFICE ADDRESS 

1203 Angelic Court 


CITV 

Carmel 


STATE ft ZIP COOC/COONTRY 

Indiana 46032 US 



; J I hereby declare thai all statements made herein of my own icnpwledge are true and that ail statements made on 
information and belief are believed to be true; and further that these statements were made with the knowledge 
that wiliful false statements and the like so made are punishable by fine or imprisonment, or both, under section 
1 00 1 of Title IS of the United States Code, and that such willful false statemenu may jeopardize the validity of 
the application or any patent issuing thereon, 

SIGNATURE OF iNVENTOft 20*^ 



Chia-Yuan Teng^"' 



SXjNATURC Of INVENTOR 2C5 

Mehitiet Kemal Ozk^^ 



SIGNATURE OP INVENTOA 20 6 

Timothy William Saeger 



□ATE 



OATE 



2000 



2000 



2000 



PTO "39' PPV -0 83- 



Paqp 3o' 3 



U S OEPARTMENT Of C0MM£«:E Pate'-t jr-: " 



COMBINED DECLARATION FOR PATENT APPLICATION AND POWER OF ATTORNEY 

{IncliJdes Reference so PCT InTernattonai Apphcattons) ^ ^ 



ATTORNEY S DOCKET NUMBER 

RCA 88759 



As a below namecT inventor, I hereby declare that: 
My residence, post office address and citizenship are as stated below next to my name, 

1 believe \ am the original, first and sole inventor (if only one name is listed below) or an original, first and joint 
inventor (if plural names are listed below) of the subject matter which is claimed and for which a patent is sought 
on the invention entitled: 

SYSTEM FOR FORMATTING AND PROCESSING MULTIMEDIA PROGRAM 

DATA AND PROGRAM GUIDE INFORMATION 



the specification of which (check only one item below): 
n is attached hereto. 
□ was filed as United States application 

Serial No. ■ — 



on 



and was amended 

on (if applicable). 

was filed as PCT international application 
PCT/US98/21556 



Number 



13 October 1998 
on , 



and was amended under PCT Article 19 and Art . 3 4 

on 25 March 1999 and 27 October 1999 (if applicable). 



I hereby state that I have reviewed and understand the contents of the above-identified specification, including 
the claims, as amended by any amendment referred to above. 

I acknowlege the duty'to disclose information which is material to the examination of this application in 
accordance with Title 37, Code of Federal Regulations, § 1.56(a), 

I hereby claim foreign priority benefits under Title 35, United States Code, §119 of any foreign application(s) 
for patent or inventor's certificate or of any PCT international application(s) designating at least one country 
other than the United States of America listed below and have also identified below any foreign application(s) 
for patent or inventor's certificate or any PCT international appiication(s) designating at least one country other 
than the United States of America filed by me on the same subject matter having a filing date before that of the 
application(s) of which priority is claimed: 



PRIOR FOREIGN/PCT APPUCAT10N{S) AND ANY PRIORITY CLAIMS UNDER 35 U.S.C. 110: 



COUNTRY 

(if PCT, tndicate PCT ") 


APPLICATION NUMBER 


DATE OF FILING 
{day, month, year) 


PRIORITY CLAIMED 
UNDER 35 use 119 








□ YES □ NO 








□ YES □ NO 








□ YES □ NO 








□ YES □ NO 








□ YES □ NO 
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U.S. DEPARTMENT OF COMMERCE-Paiem and Trademark Offic 



Combined Declaration For Patent Application and Power of Attorney (Continued) 

(Includes Reference to PCT International Applications) t , 



ATTORNEY S DOCKET NUMBHfl 

RCA , 



I hereby claim the- benefit under Title 35, United States Code, §120 of any United States application(s) or PCT 
international applicationfs) designating the United States of America that is/are listed below and, insofar as the 
subject matter of each of the claims of this application is not disclosed in that/those prior application{s) in the 
manner provided by the first paragraph of Title 35, United States Code, §112, I acknowlege the duty to disclose 
material information as defined in Title 37, Code of Federal Regulations, § 1.56(a) which occurred between the 
filing date of the prior appiication(s) and the national or PCT international filing date of this application: 



PRIOR U.S. APPLICATIONS OR PCT INTERNATIONAL APPLICATIONS DESIGNATING THE U.S. FOR BENEFIT UNDER 

35U.S-C.120: 



US APPLICATIONS 


STATUS {Check one) 


us APPLICATION ^4UMBER 


U S FILING DATE 


PATENTED 


PENDING 


ASANDONEO 


50/061897 


14 October 1997 (14,10.97) 




























PCT APPLICATIONS DESIGNATING THE U.S 








PCT APPLICATION NO 


PCT FILING DATE 


U S SERIAL NUMBERS 
ASSIGNED (if any) 








PCT/US98/21556 


130ctober 1998 (1 


3.10. 98) 

































POWER OF ATTORNEY: As a named inventor, I hereby appomt the following attornev(s) and/or agent(s) to prosecute 
this application and transact alt business in the Patent and Trademark Office connected therewith. (List name and registra- 
tion number} Joseph S. Tripoli - Reg. No. 2 6,040 

Eric P. Herrmann - Reg. No. 29,169 

Alexander J. Burke - Reg. No. 40,425 



^nd Correspondence to: 

Joseph S. Tripoli - Patent Operations 

THOMSON multimedia Licensing Inc. 
J PO Box 5312 

J: Princeton, New Jersey 08540 US 



Direct Telephone Calls to: 

(naate and telephone number} 

1-609-734-9503 



FULL NAWie 
OF INVENTOR 



FAMILY NAME 

EBLING 



FiRST GtVEN NAME 

Mark 



SECOND GIVEN NAME 

Jacob 



RESIDENCE & 
CITIZENSHIP 



CITY 



Indianapolis 



STATE OR FOREIGN COUNTRY 

Indiana 



COUNTRY OF CITIZENSHIP 

US 



POST OFFICE 
ADDRESS 



POST OFFICE ADDRESS 

6709 Stearns Hill Drive 



Indianapolis 



STATE & Zip CODE/COUNTRY 

Indiana 46237 US 



FULL NAME 
OF INVENTOR 



FAMILY NAME 

HEREDIi 



FIRST GIVEN NAME 

Edwin 



SECOND GtVEn NAME 

Arturo 



RESIDENCE & 
CITIZENSHIP 



CITY 

San Jose 



Ml 



^TATE OR FOREIGN COUNTRY 

California 



COUNTRY OF CITIZENSHIP 

Boliva 



POST OFFICE 
ADDRESS 



POST OFFICE ADDRESS-L7QQ NOrth 

First Street # 235 



STATE & ZIP CODE/COUNTRY 

California 95112 US 



FULL NAME 
OF INVENTOR 



FAMILY NAME 

N I RAN J AN 



FiRST GIVEN NAME 

Sithampara 



SECOND GtVEN NAME 



RESIDENCE & 
CITIZENSHIP 



CITY 

Redwood Shores 



STATE OR FOREIGN COUNTRY 

California 



COUNTRY OF CITIZENSHIP 

LK 



POST OFFICE 
ADDRESS 



POST OFFICE ADDRESS 

613 Canoe 



Court 



CITY 

Redwood Shores 



STATE & ZIP CODE/COUNTRY 

California 94065 US 



I hereby declare that all statements made herein of my own knowledge are true and that all statements made on 
information and belief are believed to -be true; and further that these statements were made with the knowledge 
that willful false statements and the like so made are punishable by fine or imprisonment, or both, under section 
1001 of Title 18 of the United States Code, and that such willful false statements may jeopardize the validity of 
the application or any patent issuing thereon. . 



SIGNATURE OF INVENTOR 201 

Mark Jacob Eb/ing 



x 



DATE 



2000 



SfGfclATURE OF INVENTOR 202 ^TT Q' 

Edwin Arturo Heredia 



_^^£^^'2 000 



SIGNATURE OF INVENTOR 203 

/ 



DATE 



Sithampara/^iran j an 



U S DEPARSl^ENT OF COMMERCE-Patent and Trademark Offic 



2000 



PTO-1391 [REV 10-83] 



Page 2 



ofK3 



RCA 88759 



COMBINED DECLARATION FOR PATENT APPLICATION AND POWER OF ATTORNEY 

(Continued) 



ft 





OF INVENTOR 


FAMU.Y NAME 


FIRST OIVENNAMI 

CHIA-YUAN 


StCONO GIVEN NAME 




CinZENSHP 


OTV 

San Di^^o^ 


STATE ORMMtGN COUNTKV 

California 


COUMTRV Of OTtZENSHlP 

Taiwan 




POST OFFICE 
A00AE55 


PQSTOFFCE AOORESS 

7384 Celata Lane 


CITY 

San Diego 


STATE & ZIP COOE/COUNTRY 

California 92129 US 




FUCL NAMC 


FAMILY NAME 


FIRST GIVEN NAME 


SECOND GIVEN NAME 


i 


OF INVENTOH 


OZKAS . 


Mehmet 




; CN 


R€StO€NC£ k 
CtTI2ENSH# 


Istanbul '^^f^}^ 


^TA TE OR FOREKjN COUNTRY 

Turkey 


COUNTRY Of OTIZENSHIP 

TR 




POST OFFICE 


POST OFFICE AC30RESS Savasci Sok, 


OTY 


STATE ft Z3P COOE/COUNTRY 




AOOAESS 


Bozokatt 19/1 Avcilar 


Istanbul 


34840 TR 




FULL NAMt 
OF INVENTOR 


FAMILY NAME 

SAEGER 


FIRST GIVEN NAME 

Timothy 


SECOND GIVEN NAME 

William 


a. 


RESI0€NCE4 
CIT1ZENSH# 


OTV 

Carmel 


STATE OR FOREKjN COUNTRY 

Indiana 


COUNTRY Of aTI2£NSN»R 

US 




TOST Of F)C£ 
ADDRESS 


POST OFFfCE AOORESS 

1203 Angelic Court 


CITY 

Carmel 


STATE ft ZIP COOE/COUNTRY 

Indiana 46032 US 



I hereby declare that all statements made herein of my own knQwledge are true and that all sutements made on 
information and belief are believed to be true; and further that these statements were made with the knowledge 
that willful false statements and the like so made are punishable by Hne or imprisonment* or both, under section 
1001 of Title 18 of the United States Code, and that such willful false sutements may jeopardize the validity of 
the application or any patent issuing thereon. ^^-- —-----^ 

4 """"TcuiklT^rifte tiduc^ 



SiGNATU! 



IF INVENTOR 20' 

Chia-^Yuan 



SKaNATVJRE OF INVENTOR 2C5 

Mehmet Kemal 



zkan 



SIGNATURE OP INVENTOR 20 6 



Timothy William Saeger 



DATE 



2000 



OATg 



X 2000 



DATE 



2000 



BTO '391 i^EV '0 83- 



U S DEPARTMENT OF COMMERCE Pa«"t :sr- ' , jfx ' M^.ce 



COMBy\iED DECLARATION FOR PATENT APPLICATION AND POWER OF ATTORNEY 

{Includes Ref^^rence PCT Internationa! Applications) 



ATTORNEY S OOCKE'r NUMBER 

RCA 88759 



As a below named' inventor 1 hereby declare that; 
My residence, post office address and citizenship are as stated below next to my name, 

I believe I am the original, first and sole inventor (if only one name is listed below) or an onginal, first and joint 
inventor (if plural names are listed below) of the subject matter which is claimed and for which a patent is sought 
on the invention entitled: 

SYSTEM FOR FORMATTING AND PROCESSING MULTIMEDIA PROGRAM 

DATA AND PROGRAM GUIDE INFORMATION 



the specification of which (check only one item below): 

Q is attached hereto. 

D was filed as United States application 

Serial No. 

on ^ 

and was amended 

on - ^ . (if applicable). 

S was filed as PCT international application 

Number PCT/US98/ 21556 

13 October 1998 

on ~ . — , 

and was amended under PCT Article 19 and Art • 3 4 

on 25 March 1999 and 27 October 1999 (if applicable). 



I hereby state that I have reviewed and understand the contents of the above-identified specification, including 
the claims, as amended by any amendment referred to above. 

I acknowlege the duty~to disclose information which is material to the examination of this application in 
accordance with Title 37, Code of Federal Regulations, §L56(a). 

I hereby claim foreign priority benefits under Title 35, United States Code, §119 of any foreign application(s) 
for patent or inventor's certificate or of any PCT international appiication(s) designating at least one country 
other than the United States of America listed below and have also identified below any foreign application{s) 
for patent or inventor's certificate or any PCT international application(s) designating at least one country other 
than the United States of America filed by me on the same subject matter having a filing date before that of the 
application(s) of which priority is claimed: 



PRIOR FOREIGN/PCT APPUCATION{S| AND ANY PRIORITY CLAIMS UNDER 35 U.S.C. 1 1 9: 



COUNTRY 

(if PCT. indicate PCT '^ 


APPLICATION NUMBER 


DATE Of FILING 
(day, month, yearl 


PRtOFtJTY CLAIMED 

UNDER 35 use ng 








□ YES □ NO 








□ yes Ono 








□ YES □ NO 








□ YES □ NO 








□ YES □ NO 
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Combined Deciaration For Patent Application and Power of Attorney (Continued) 

(Includes Reference to PCT international Applications) [ 



ATTORNEY S.DOCKET NUMBER 

RCA 8S759 



I hereby claim the^ benefit under Title 35, United Stales Code, §120 of any United States application(s) or PCT 
international applicati6n(s) designating the United States of America that is/are listed below and, insofar as the 
subject matter of each of the claims of this application is not disclosed in that/those prior application(s) in the 
manner provided by the first paragraph of Title 35, United States Code, §112, I acknowlege the duty to disclose 
material information as defined in Title 37, Code of Federal Regulations, § 1.56(a) which occurred between the 
filing date of the prior application(s) and the national or PCT international filing date of this application: 



PRIOR U.S. APPLICATIONS OR PCT INTERNATIONAL APPLICATIONS DESIGNATING THE U.S. FOR BENEFIT UNDER 

35 u s e. 120: 



U S APPLlCATiONS 


STATUS (Check one) 


U S APPLICATION NUMBER 


U S FILING DATE 


PATENTSD 


PENDING 


ABANDONED 


60/061897 


14 October 1997 (14.10.97) 




























PCT APPLICATIONS DESIGNATING THE U S 








PCT APPLICATION NO 


F>CT FILING DATE 


U S SERIAL NUMBERS 
ASSIGNED Of any) 








PCT/US98/21556 


ISOctober 1998(1 


3.10. 98) 

































POWER OF ATTORNEY: As a named inventor, I hereby appoint the following attorneY($) and/or agent(s) to prosecute 
this application and transact all business in the Patent and Trademark Office connected therewith. (List name and registra- 
tion number) Joseph S. Tripoli - Reg. No. 26,040 

Eric P. Herrmann - Reg. No. 29,169 

Alexander J. Burke - Reg. No. 4 0,425 



Send Correspondence to: 

Joseph S. Tripoli - Patent Operations 
THOMSON multimedia Licensing Inc. 
.^L PO Box 5312 

Princeton, New Jersey 08540 US 


Direct Telephone Calls to: 

{name and teiephone number) 

1-609-734-9503 




FULL NAME 
OF INVENTOR 


FAMILY NAME 

EBLING 


FIRST GIVEN NAME 

Mark 


SECOND GIVEN NAME 

Jacob 


RESIDENCE & 
ClTlZENSHtP 


CITY 

Indianapolis 


STATE OR FOREIGN COUNTRY 

Indiana 


COUNTRY OF CITIZENSHIP 

US 


POST OFFICE 
ADDRESS 


POST OFFICE ADDRESS 

6709 Stearns Hill Drive 


CITY 

i Indianapolis 


STATE & ZIP CODE/COUNTRY 

Indiana 4 6 237 US 


CN 
O 
CN 


FULL NAME 
OF INVENTOR 


FAMILY NAME 

HEREDIA 


FIRST GIVEN NAME 

Edwin 


SECOND GIVEN NAME 

Arturo 


RESIDENCE & 
CITIZENSHIP 


CITY 

San Jose 


^TATE OR FOREIGN COUNTRY 

California 


COUNTRY OF CITIZENSHIP 

Boliva 


POST OFFICE 
ADDRESS 


POST OFFICE ADDRESS-L 7 00 NOrth 

First Street ^ 235 


CITY 

San Jos fa 


STATE & ZIP CODE/COUNTRY 

California 95112 US 


CO 

o 

est 


FULL NAME 
OF INVENTOR 


FAMILY NAME 

^NIRANJAN 


FIRST GIVEN NAME 

Sithampara 


SECOND GIVEN NAME 


RESIDENCE & 
CITIZENSHIP 


CITY A 

Redwood Shores UTi 


STATE OR FOREIGN COUNTRY 

California 


COUNTRY OF CITIZENSHIP 
LK 


POST OFFICE 
ADDRESS 


POST OFFICE ADDRESS 

613 Canoe Court 


CITY 

Redwood Shores 


STATE & ZIP CODE/COUNTRY 

California 94065 US 



I hereby declare that ail statements made herein of my own knowledge are true and that all statements made on 
information and belief are believed to tie true; and further that these statements were made with the knowledge 
that willful false statements and the like so made are punishable by fine or imprisonment, or both, under section 
1001 of Title 18 of the United States Code, and that such willful false statements may jeopardize the validity of 
the application or any patent issuing thereon. 



SIGNATURE OF INVENTOR 20 1 

Mark Jacob Ebaing 


SIGNATURE OF INVENTOR 202 ^ / 

Edwin Artur^^ Heredia 


\ 


. SIGNATURE 0|= INVENTOR 203 / / 

Sithampara Niranjan 


/ 
/ 


2000 


©ATE ^^^^^^ 


200o) 


0ATE 

( 20 March 2000 


PTO-1391 {REV 10-83) 
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^ U S DEPARTMENT OF COMMERCE-Patent and Trademark O^fic 



RCA 88759 



COMBIISIED DECLARATION FOR PATENT APPLICATION AND POWER OF ATTORNEY 

(Continued) 



o 


FUU NAME 
OF fNVENTOft 


FAMILY NAME 
TENG 


FmST QIVEH NAME 

CHIA-yUAN 


S£CONO GIVEN NAMS 


R£SlD£NCe & 
CITIZENSWP 


CITY 

San Diego 


STATE OA«OfKIGN COUNTIiy 

California 


COUHTRY Of CITIZENSHIP 

Taiwan 


POST OFFICE 
AOOftESS 


POST OFFICE ADDRESS 

7384 Celata Lane 


CITY 

San Diego 


STATE & ZIP CODE/COUNTRY 

California 92129 US 


in 
o 


FUUNAME 
OF INVENTOH 


FAMILY NAME 

OZKAN 


FiRST GIVEN NAME 

Mehmet 


SECOND GIVEN NAME 

Kemal 


RESIDENCE & 
CITIZENSHIP 


CITY 

Istanbul 


wTATE OR FOREKSN COUNTRY 

Turkey 


COUNTRY OF CITIZENSHIP 

TR 


POST OFFICE 
ADDRESS 


POST oFFtcE ADDRESS Savasci SoK, 
Bozokatt 19/1 Avcilar 


OTY 

Istanbul 


STATE & ZIP COOe/COUNTRV 

34840 TR : 


o 

est 


FUa NAME 
OF INVENT0« 


FAMILY NAME 

...aS^GER ' 


FIRST GIVEN NAME 

jrimothy 


SECOND GIVEN NAME 

will.i anL^ 


RESIDENCE & 
CITIZENSHIP 


OTV 

Carmel _ N 


STATE OR FOREIGN COUNTRY 

Indiana 


COUNTRY OP citizenship"" 

US 


POST OFFICE 
ADDRESS 


POST OFFICE ADDRESS 

1203 Angelic Court 


CITY 

Carmel 


STATE h ZIP CODE/COUNTRY 

Indiana 46032 US 



I hereby declare that all statements made herein of my own knowledge are true and that all statements made on 
information and belief arc believed to be true; and further that these statements were made with the knowledge 
that willful false statements and the like so made are punishable by fine or imprisonment^ or both, under section 
1001 of Title 18 of the United States Code, and that such willful false statements may jeopardize the validity of 
the application or any patent issuing thereon. 

n — 




SIGNATURE OF iNVENTOfl 20' 

Chia-Yuan Te 



SIGNATURE OF INVENTOR 2C5 

Mehmet Kemal^XTzkan 




SM3NA>I(« OF.«(JV6NT9l^$^6 

Timothy c^Wi'lIxam Saeger 



DATE 
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ATTORNEY S DOCKET NUMBER 

RCA 88759 



As a below namecf inventor, I hereby declare that: 
My residence, post office address and citizenship are as stated below next to my name, 

I believe I am the original, first and sole inventor (if only one name is listed below) or an original, first and joint 
inventor (if plural names are listed below) of the subject matter which is claimed and for which a patent is sought 
on the invention entitled: 

SYSTEM FOR FORMATTING AND PROCESSING MULTIMEDIA PROGRAM 



DATA AND PROGRAM GUIDE INFORMATION 



the specification of which (check only one item below): 
O is attached hereto. 
□ was filed as United States application 

Serial No. 



on - — _ ~ 

and was amended 

on (if applicable). 

H was filed as PCT international application 

Number PCT/US98/ 21556 

13 October 1998 
on — _ — _ . — . — . 

and was amended under PCT Article 19 and Art . 3 4 

on 25 March 1999 and 27 October 1999 af applicable). 



I hereby state that I have reviewed and understand the contents of the above-identified specification, including 
the claims, as amended by any amendment referred to above. 

I acknowlege the duty"to disclose information which is material to the examination of this application in 
accordance with Title 37, Code of Federal Regulations, §L56(a). 

I hereby claim foreign priority benefits under Title 35, United States Code, §119 of any foreign appUcation(s) 
for patent or inventor's certificate or of any PCT international application(s) designating at least one country 
other than the United States of America listed below and have also identified below any foreign application{s) 
for patent or inventor's certificate or any PCT international application(s) designating at least one country other 
than the United States of America filed by me on the same subject matter having a filing date before that of the 
application(s) of which priority is claimed: 



PRIOR FOREIGN/PCT APPUCATION(S) AND ANY PRIORITY CLAIMS UNDER 35 U.S.C. 1 1 9: 



_ _ . — i 


COUNTRY 
(if PCT, indicate PCT') 


APPUCATiON NUMBER 


DATE OF FILING 
(day, month, year) 


PRIORITY CLAIMED 
UNDER 35 use 1 19 
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I hereby claim the- benefit under Title 35, United States Code, §120 of any United States application(s) or PCT 
international appiicati6n(s) designating the United States of America that is/are listed below and, insofar as the 
subject matter of each of the claims of this application is not disclosed in that/ those prior application(s) in the 
manner provided by the first paragraph of Title 35, United States Code, §112, I acknowlege the duty to disclose 
material information as defined in Title 37, Code of Federal Regulations, § 1.56(a) which occurred between the 
filing date of the prior appiication(s) and the national or PCT internatfonal filing date of this application; \ 



PRIOR U.S. APPLICATIONS OR PCT INTERNATIONAL APPLICATIONS DESIGNATING THE U,S. FOR BENEFIT UNDER 

35 u s e, 120: 



U S APPLICATIONS 


STATUS (Check one! 


U S APPLICATION NUMBER 


U S RUNG DATE 


PATENTED 


PENDING 


ABANDONED 


60/061897 


14 October 1997 (14,10.97) 




























PCX APPLICATIONS DESIGNATING THE U.S. 








PCT APPLICATION NO 


PCT FILING DATE 


U S SERIAL NUMBERS 
ASSIGNED Of^ny) 








PCT/US98/21556 


ISOctober 1998 (1 


3,10.98) 

































POWER OF ATTORNEY: As a named inventor, I hereby appoint the following attornev(s) and/or agent(s> to prosecute 
this application and transact all business in the Patent and Trademark Office connected therewith. (List name and registra- 
tion nun^ber) Joseph S. Tripoli - Reg. No. 26,040 

Eric P. Herrmann - Reg. No. 29,169 

Alexander J. Burke - Reg. No, 40,425 



$$nd Correspondence to: 

^ Joseph S. Tripoli - Patent Operations 
j THOMSON multimedia Licensing Inc. 
/."PO Box 5312 

f jPrinceton, New Jersey 08540 US 


Direct Telephone Calls to: 

{name and telephone number) 

1-609-734-9503 




S FULL NAME 
^ OF INVENTOR 


FAMILY NAME 

EBLING 


FIRST GIVEN NAME 

Mark 


SECOND GIVEN NAME 

Jacob 




RESIDENCE & 
CITIZENSHIP 


CITY 

Indianapolis 


STATE OR FOREIGN COUNTRY 

Indiana 


COUNTRY OF CITIZENSHIP 

US 




POST OFFICE 
ADDRESS 


POST OFFICE ADDRESS 

6709 Stearns Hill Drive 


CITY 

i Indianapolis 


STATE & ZIP CODE/COUNTRY 

Indiana 46237 US 




FULL NAME 
OF INVENTOR 


FAMILY NAME 

HEREDIA 


FIRST GIVEN NAME 

Edwin 


SECOND GIVEN NAME 

Arturo 


O 

CN 


RESIDENCE & 
CITIZENSHIP 


CITY 

San Jose 


^TATE OR FOREIGN COUNTRY 

California 


COUNTRY OF CITIZENSHIP 

Boliva 




POST OFFICE 
ADDRESS 


POST OFFICE AooRess-|_ -jQQ North 
First Street # 235 


CITY 

.aan Jnsfi 


STATE & ZIP CODE/COUNTRY 

California 95112 US 




FULL NAME 
OF INVENTOR 


FAMILY NAME 

NIRANJAN 


FIRST GIVEN NAME 

Sithampara 


SECOND GIVEN NAME 


CO 

o 


RESIDENCE & 
CITIZENSHIP 


CITY 

Redwood Shores 


STATE OR FOREIGN COUNTRY 

California 


COUNTRY OF CITIZENSHIP 

LK 




POST OFFICE 
ADDRESS 


POST OFFICE ADDRESS 

613 Canoe Court 


CITY 

Redwood Shores 


STATE & ZIP CODE/COUNTRY 

California 94065 US 



I hereby declare that all statements made herein of my own knowledge are true and that all statements made on 
information and belief are believed to -be true; and further that these statements were made with the knowledge 
that willful false statements and the like so made are punishable by fine or imprisonment, or both, under section 
1001 of Title 18 of the United States Code, and that such willful false statements may jeopardize the validity of 
the application or any patent issuing thereon. 
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AOOAeSS 


POSTOFFtCE ADDRESS 

7384 Celata Lane 


CITY 
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STATE & ZJP COOe/COUNTRY 

California 92129 US 




FULL NAMC 
OF fNVENTOH 


FAMILY NAME 

OZKAN 


FIRST GIVEN NAME 

Mehmet 


SECOND GIVEN NAME 

Kemal 
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RESIDENCE 4 
CtTIZENSH# 


CITY 

Istanbul 


^TA TE OR FOflEHjN COUNTRY 

Turkey 


COUNTRY Of CITIZENSHIP 

TR 




POST OFFJCH 
AOOAESS 


POST OFFICE Aooftcss Savascx Sok. 
Bozokatt 19/1 Avcilar 


CITY 

Istanbul 


STATE & ZIP COOE/COUNTRY 

34840 TR 
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SAEGER 
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